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Period for Reply 

A SHORTENED STATUTORY PERIOD FOR REPLY IS SET TO EXPIRE 3 MONTH(S) FROM 
THE MAILING DATE OF THIS COMMUNICATION. 

- Extensions of time may be available under the provisions of 37 CFR 1.136(a). In no event, however, may a reply be timely filed 
after SIX (6) MONTHS from the mailing date of this communication. 
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DETAILED ACTION 



A request for continued examination under 37 CFR 1.114, including the fee set 
forth in 37 CFR 1 .17(e), was filed in this application after final rejection. Since this 
application is eligible for continued examination under 37 CFR 1.114, and the fee set 
forth in 37 CFR 1 .17(e) has been timely paid, the finality of the previous Office action 
has been withdrawn pursuant to 37 CFR 1.1 14. Applicant's submission filed on 
08/25/03 has been entered. 

Response to Arguments 

Applicant's arguments with respect to claims 1-14 have been considered but are 
moot in view of the new ground(s) of rejection. 

Claim Rejections - 35 USC § 102 

The following is a quotation of the appropriate paragraphs of 35 U.S.C. 102 that 
form the basis for the rejections under this section made in this Office action: 
A person shall be entitled to a patent unless - 

(b) the invention was patented or described in a printed publication in this or a foreign country or in public 
use or on sale in this country, more than one year prior to the date of application for patent in the United 



States. 



1 . Claims 1-4, 6-7, and 9-10 are rejected under 35 U.S.C. 102(b) as being 
unpatentable by Adams et al. (US 5541662). 
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Regarding claim 1 , Adams discloses a method of displaying (Fig.8) a 
document (associated data/Buttons with images of related items for sale) together 
with a time stamp (Fig. 5, el. 84) specified display of video element (Fig.8, Video 
Windows) comprising the steps of: 

Providing the document (Associated Data) including a structure (Fig. 5) for 
receiving a time stamp value (Fig. 5, el. 84) associated with the video element (video 
Packet) in a packetized elementary stream (Fig. 5; Col. 4, lines 34-65); 

Reading the time stamp value in the document (associated Data) and at least 
one of providing and signaling the availability of document (by displaying the Buttons 
with images of related items for sale) to a viewer in accordance with the time-stamp 
value (Col. 8, lines 51-63). 

As to "inserting said time stamp value said associated with said video element 
in said structure", Adams does not specifically disclose it; However, Adams shows 
the Associated Data's structure with the time-stamp field (Fig.5) f Adams must insert 
the time stamp value associated with the video element in the structure at the 
Headend in order to perform the above function at the receiver as disclosed. 

Regarding claim 2, Adams further discloses wherein the availability of the 
document (associated data/Buttons with images of related items for sale) is signaled 
by displaying the document (displays buttons with images of related items for sale; 
see Fig. 8); 

Regarding claims 3 and 9, Adams further discloses wherein the presence of the 
document is signaled by displaying to the viewer a notice of the availability/command by 
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which the viewer can cause the document to be displayed (see Fig. 8; Col. 8, lines 64- 
Col. 9, lines 1) 

Regarding claim 4, Adams further discloses wherein the time stamp value is 
encoded in a data packet with the document before the data packet is transmitted 
(see Fig. 5 wherein the time stamp 84 must be encoded before the data packet is 
transmitted; Col. 4, lines 34-65). 

Regarding claim 6, Adams discloses a method of displaying (Fig. 8) a 
document (associated data/Buttons with images of related items for sale) together 
with a time stamp (Fig. 5, el. 84) specified display of video element (Fig.8, Video 
Windows) comprising the steps of: 

Providing the document (Associated Data) including a structure (Fig. 5) for 
receiving a time stamp value (Fig. 5, el. 84) specifying a display time for the 
document (Fig.5; Col. 4, lines 34-65; Col. 7, lines 15-21); 

Reconstructing the document (associated data) from the first data packet 
(Video packet) see Fig. 8; reading the time stamp value in the document; and 
providing or signaling the availability of the document to a viewer and displaying the 
target datum of the at least one of the video element and the audio element at the 
display time specified by the time stamp value is described in Col. 8, lines 51 -Col. 9, 
lines 48. 

As to "Encoding in a packetized elementary stream a first data packet (video) 
comprising the document and the time stamp value; and Encoding in a packetized 
elementary stream a second packet (audio) comprising the time stamp value and a 
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target datum in either the video or audio element", Adams must encodes the 
corresponding video/audio/associated data stream into packetized elementary 
stream as shown in Fig. 5. 

As to "capturing the time stamp value from the first data packet; Inserting the 
time stamp value into the structure for receiving the time stamp value", Adams does 
not specifically disclose it; However, Adams shows the Associated Data's structure 
with corresponding time-stamp field in Video/Audio/Associated packets see Fig. 5 in 
which Adams must capture the time stamp value from the Video data packet and 
insert the time stamp value associated with the video element in the structure of the 
Associated data packet in order to synchronize the presentation of the associated 
data with the video data and to perform the above function as disclosed. 

Regarding claim 7, Adams further discloses, wherein the availability of the 
document (associated data/Buttons with images of related items for sale) is signaled 
by displaying the document (displays buttons with images of related items for sale; 
see Fig. 8); 

Regarding claim 10, Adams further discloses transmitting the first (Video) 
and second (Audio) data packets to a receiver; see Col. 4, lines 5-14. 

Claim Rejections - 35 USC § 103 

The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 102 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
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invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

2. Claims 5 and 8 are rejected under 35 U.S.C. 103(a) as being unpatentable over 
Adams et al. (US 5541662) in view of Harrison et al. (US 6064420). 

Regarding claim 5, Adams does not clearly disclose wherein the time stamp 
value is inserted in the structure after the document is transmitted. 

Harrison discloses a script is generated from sub-system 20 and sent over 
the terminal to synchronize the pre-stored associate data at local storage 80 with the 
display (by executing the script, the pre-stored associate data at the terminal is 
synchronizing with the received main/primary data stream to display to viewer based 
on the inserted time stamp/time code value from the receiving stream; Col. 5, lines 
1-18). Therefore, it would have been obvious to one of ordinary skill in the art at the 
time the invention was made to modify Adams to insert the time-stamp in the 
structure after the document is transmitted, as taught by Harrisson, so to enhance 
the quality and content of the primary information stream with corresponding 
targeted associated data (see Summary of the invention). 

Regarding claim 8, Harrisson further discloses including in the document 
(associate data) a display time interval and terminating the display of the document 
(associate data) at a time specified by the display time interval and the time stamp 
value" (time code and time duration; Col. 5, lines 2-53). 
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3. Claims 1 1-14 are rejected under 35 U.S.C. 103(a) as being unpatentable over 
Adams et al. (US 5541662) in view of Eyer (US 5982445), and further in view of 
Harrison et al. (US 6064420). 

Regarding claim 1 1 , with respect to analysis of claim 1 , Adams must have "a 
document server" for delivering the document (associate data) including a structure 
for receiving a time stamp value as a first data stream to a packet assembler said 
delivery being coordinated with the arrival of a target datum in a second data stream 
representing said at least one of a video stream element and an audio element; "a 
packet assembler" for encoding in a packetized elementary stream a first data 
packet comprising a data unit representing the document (associated data) and a 
time stamp value specifying a time for displaying the document (associated data); 
and a second data packet comprising the target datum and the time stamp value unit 
and the time stamp value"; "a packet disassembler for separating the data unit and 
the time stamp value from the first data packet" in order to perform the method as 
discussed in claim 1. 

As to limitation "a parser to reconstruct the document from the data unit" and 
"a data presentation engine to read the document", Adams does not clearly disclose 
it; However, Adams discloses a client runtime manager 102 reads incoming packets 
video/audio/associated packets and distributes them to corresponding functions 
within the receiver (Col. 8, lines 32-Col. 9, lines 10). 
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Eyer discloses a parser and presentation engine (browser) to reconstruct the 
document from the data unit (Fig. 2; element 220, 215; Col. 8, lines 44-48 and Col. 
9, lines 13-21); 

Therefore, it would have been obvious to one of ordinary skill in the art at the 
time the invention was made to modify Adams to include a parser and data 
presentation engine (Browser); as taught by Eyer; so to identify displayable objects 
and display instructions from HTML codes so that a browser could display 
corresponding HTML pages to viewers. 

As to limitation "a time stamp loader to insert the time stamp value into the 
structure for receiving the time stamp value"; Adams and Eyer do not clearly 
disclose it. 

Harrison discloses a script is generated from sub-system 20 and sent over 
the terminal to synchronize the pre-stored associate data at local storage 80 with the 
display (by executing the script, the pre-stored associate data at the terminal is 
synchronizing with the received main stream to display to viewer based on the 
inserted time stamp value from the; Col. 5, lines 1-18). Therefore, it would have 
been obvious to one of ordinary skill in the art at the time the invention was made to 
modify Adams in view of Eyer to have a time-loader (script) to insert the time-stamp 
in the structure after the document is transmitted, as taught by Harrison, so to 
enhance the quality and content of the primary information stream with 
corresponding targeted associated data (see Summary of the invention). 
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Regarding claim 12, Adams further discloses wherein the availability of the 
document (associated data/Buttons with images of related items for sale) is signaled 
by displaying the document (displays buttons with images of related items for sale; 
see Fig. 8); 

Regarding claim 1 3, Eyer further discloses a storage device to store the 
reconstructed document (Fig. 2; element 210; Col. 11, lines 8-12) and a command 
device enabling the viewer to cause the display of the document (Fig. 2; element 
232; Col. 9, lines 1-5 & 46-50). 

Regarding claim 14, Adams further meets the limitation "further comprising a 
transmission and receiving system for transferring data packets to a receiver" (see 
Fig. 1). 

Conclusion 

The prior art made of record and not relied upon is considered pertinent to 
applicant's disclosure. 

Ramaswamy (US 6295647) shows context life time management of a user 
interface in a digital TV broadcast. 

Gerba et al. (US 5931908) shows visual object present within live programming 
as an actionable event for user selection of alternate programming wherein the 
actionable event is selected by human operator at a headend for distributed data and 
programming. 
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Any response to this action should be mailed to: 

Commissioner of Patents and Trademarks 
Washington, D.C. 20231 

or Faxed to: 703-872-9306 



(for informal/draft communications, please label "PROPOSED" or 



Hand-delivered responses should be brought to Crystal Park II, 2121 Crystal Drive, 
Arlington, VA., Sixth Floor (Receptionist). 

Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Hai Tran whose telephone number is 703-308-7372: 
The examiner can normally be reached on M-F. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Andrew Faile can be reached on 703-305-4380. The fax phone number for 
the organization where this application or proceeding is assigned is 703-872-9306. 

Any inquiry of a general nature or relating to the status of this application or 
proceeding should be directed to the receptionist whose telephone number is 703-306- 



DRAFT") 



0377. 
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